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^ ' Abstract 

On 

r-j . We study the possibility to produce single t-quarks both at LEP II and HERA. While 

within the Standard Model such reactions are not observable, the possibility exists in 
a wide class of dynamical models for the fermion mass generation. General arguments, 
rCi • based on hierarchical and democratic symmetries are used to arrive at t-production rates 

which are detectable. 
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It is well-known that within the theoretical framework of the electroweak theory based 
on the gauge group 577(2) x (7(1) a deeper understanding of the observed mass spectra of 
the leptons and quarks is not possible. The observations show that the masses in the various 
charged flavor channels (quarks, charged leptons) are strongly dominated by the masses of the 
third fermion family m t ,mb and m T respectively, a clear hierarchical pattern is observed. It 
is not known whether such a mass hierarchy is present also in the neutrino sector. In fact, it 
may well be that in the neutrino channel no mass hierarchy exists, which might be the reason 
for the large mixing angles indicated by the neutrino oscillation experiments Q. 

The observed mass hierarchies and a related hierarchy of the flavor mixing angles in the 
quark sector suggest that nature seems to be close to the "rank-one limit" , in which all flavor 
mixing angles vanish and the mass matrices are proportional to the rank-one matrix @, [| 



M = const. 



I \ 

1 



(1) 



This mass matrix can also be represented, after a linear transformation of the fermion 
fields, by the "democratic" mass matrix: 



/ 



const. 



1 1 



(2) 



which exhibits an 5(3) l x S(3)r symmetry ||. [J. 

The mass generation for the members of the second and first family of fermions can be 
related to a specific breaking of the "democratic symmetry" P, ||, 0. 

Thus far the details of the dynamics which generate the masses and flavor mixing effects 
are unknown. They might be related, for example, to the presence of new interactions, or 
to a substructure of the leptons and quarks. We shall not speculate about those here, but 
rather concentrate on possible general consequences for the physics at LEP II and HERA. 
Once the masses of the fermions are generated, terms of the type ipLipR + he (tp: fermion 
field, L: lefthanded, R: righthanded) are introduced. These terms serve as bridges between 
the lefthanded fields and the righthanded ones. In the Standard Model the mass terms are, 
of course, provided by the interaction of the scalar field with the fermions. However, in a 
dynamical theory of the mass generation one expects that besides the fermion mass terms 
also effective interactions between the fermions and the electroweak or QCD gauge bosons are 
generated, which have a similar chiral structure as the mass terms, e. g. const. ipL a^vipR F^ u , 
where F^ u stays generically for a field strength of an electroweak gauge boson or a gluon. Of 
course, such terms, if present, would have to be interpreted as signals of new interactions 
beyond those present in the Standard Model. 



If we consider for the quarks the "rank-one" limit discussed above we can only have terms 
of the type ii £r F^ v or b^o ' ilv h^F liV (+ h.c). Diagonal terms like cl cr^u cr F^ v or 
flavor-changing terms like cl cr^^tR F^ u would violate the chiral symmetry SU (2)^ x SU(2)r, 
acting on the first two families, which is present in this limit. For example, the flavor-diagonal 
terms for the anomalous magnetic moments can be written as 



(3) 



U,D, 



m uo = m t , m D0 = m h ) 



V 



d 1 l\ 

A" = 111. (4) 
1 1 l) 

Here A is a scale parameter describing the energy scale of the underlying dynamics, which 
is supposedly of the order of m t . After diagonalization it is easily seen that the anomalous 
magnetic moment contributions would only be present (in the symmetry limit) for the fermions 
of the third family. Flavor-violating terms which could give rise to radiative decays like t — > cr/ 
or b — > 57 do not appear. 

Once this symmetry is broken and the masses of the quarks of the second family m c 
and m s enter, effective transition terms between the fields of the second and third family 
will in general be generated. After diagonalization of the mass terms (i. a. after rotating 
away flavor changing mass terms) a flavor mixing between the third and second family will 
appear. However, there is no reason why at the same time the flavor changing transition terms 
mentioned above would be rotated away. Thus we expect terms of the type ci J cr IJ , u tRF^ u or 
$l &[iu bR F^ v to be present. Also in the Standard Model such effective interactions are present, 
generated in higher orders of the electroweak interactions, but in case of the tc-transition they 
are too small to be interesting for experiment ||. 

As an illustrative example we consider the simplest type of S(3)l x 5 , (3)^-symmetry 
breaking discussed in Ref. 0. Both the mass terms of the charge 2/3(U) and charge —1/3- 
quarks (D) have the form: 



Mi = Mr 



0? 
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V 1 
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1 + e 



(5) 



(the index i stands for U, D respectively). 

The symmetry breaking parameter e destroys the rank one nature of the mass matrix. 
Thus the mass of the second family member (c, s respectively) is introduced. At the same 
time a flavor mixing angle appears, which is proportional to the mass ratios m s /mb and 
m c /m t ||. We also note that according to the observed mass spectrum ejj is smaller than e^,: 
eu/e D = 0.1. 



The anomalous magnetic moments of the quarks are described by a term proportional to 

~(^)qL^ v Nq R -F^ + h.c. (6) 

where the flavor matrix jV is given in analogy to the mass matrix by: 

(l 1 1 \ 



Ni 



1 1 1 

v 1 1 1 + Si j 



(7) 



(i — U,D respectively) . 

For symmetry reasons both the mass terms and the magnetic moment terms are given by 
matrices in family space where the (3, 3)-terms are different from one. If the parameters £j and 
5i were identical, the diagonalization of the mass matrices and of the magnetic moment matri- 
ces could be carried out using the same unitary transformation. Thus no flavor-nondiagonal 
terms would arise. 

Since mass terms and magnetic moments probe different properties of the fermions, albeit 
they are similar in their chiral structure, there is no reason that the symmetry breaking 
parameters £j and Si are the same, although they are expected to be of the same order of 
magnitude. Thus flavor-nondiagonal terms are expected to arise as soon as the S(3)l x S(3)r- 
symmetry is violated. In our example these terms are proportional to m c /m t or m s /m b 
respectively: 

C{t^c) = const. (^j hcr^CRF"" + h.c. , 

C (b - s) = const. ~ • (^) (^) h <v s R F^ + h.c. . (8) 

Here the const, in front depends on how far the ratios of the symmetry breaking parameters 
Si/ Si differ from unity. 

The example discussed above shows that the t- and 5-quarks might have properties like 
anomalous magnetic moments, which in principle are expected to give rise to flavor-changing 
decays. How large these amplitudes are, depends on the expected misalignment between the 
mass matrices and the matrices describing the magnetic moment transitions. 

^From our discussion it is evident that these misalignments are due to the S(3)l x S(3)r- 
breaking. They will not be present in the symmetry limit. In our example they are of the 
order of the mixing angles, i. e. of order m c /m t or m s /m h . In special situations the angles 
describing the misalignment can be of order {m c /m t ) l l 2 or [m c jm\) x l 2 \ this is the case, if the 
(2,2)-matrix element vanishes in the magnetic moment matrix, if written in the hierarchy 
basis. In this case one finds e. g. for the t — c-transition: 

6 / Tfl \ ^~l 2 — 

C{t -> c) = const. • — • — t L a„ v c R F» u + h.c. . (9) 



2A \m t J 



In order to be general we shall allow for this possibility in our discussion below. 

Both for the interaction of the t-quark with the photon and the Z-boson we obtain anoma- 
lous vertices as follows: 



A* = c{i{C z + D zlb )(T^^tZ^ 

A; c = c(i(C 7 + £ 7 7 5 )<7^W. (10) 
V m t J 



According to our discussion above we expect for the order of magnitudes of the vertex 
parameters C, D: 

Tfi / in 

const. • — - • e < C 7 , D~ < const. • J — - • e 
m t y m t 

Tfi / Tfi 

const. • gz < C z , D z < const. • J— ■ g z (11) 

m t V m t 



(gz- Z-boson coupling constant) 



9z = —n-. (12) 

COS0 W 



Thus we expect the C, D-parameters to be of the order of 10~ 2 down to the order of 1CT 3 . 
Below we shall discuss the consequences for t-decays and t-production in several exerpimental 
situations. 

Top Decays 

Besides the decay t — > b + W described within the Standard Model the decays t ^ cZ, 
t — > C7 proceed via the anomalous vertices. We find: 

r (t c Z) = (| C ,|. + m >) fU-^)U.lMl. , (13) 

v ' 8n \ mi ) \ 2 mf 2 mf 



r(t-c 7 ) = (|c 7 | 2 + |D 7 | 2 )^. (14) 

The standard decay is given by: 



8ttV2 

For the branching ratios we obtain: 



2/1 2 4 

mf I \ mf mt 



*4 W i i M l i M < 



Ml _ 2 M* V 

mf mi 



RP _ r(*->cr) _ yg 1 /Vi 2 + mi 2> i n?^ 
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For the decays t — > C7, t — > cZ exist the following experimental bounds ||: 

BR(t^qZ) < 0.4, 

BR(t^q~f) < 0.029. (18) 



Thus we obtain: 



|C Z | 2 + |D Z | 2 < 0.16, 

|C 7 | 2 + |D 7 | 2 < 6.5 -lO" 3 . (19) 
For an order of magnitude estimate we take C = D and find: 

C z , D z < 0.3, 

C 7 , L> 7 < 0.06 . (20) 

These bounds are significantly larger than the values estimated above, especially those con- 
cerning the Z-interaction. If we take C, D to be in the upper range (see Eq. (|TT|)), one finds 
BR(t — > cy) and BR(t — ► cZ) to be of the order of 1 %. For our subsequent discussion we 
shall take this branching ratio as a guideline. 

The Production of Single t-quarks at LEP II 

If the anomalous vertices given in Eq. ([TT]) are present, it is possible to produce single 
t-quarks in e + e~-annihilation above about 180 GeV via the reaction e + e~ — > 7, Z — > ct, ic. 
This possibility has also been discussed in Ref. |T(J based on a different set of anomalous 
operators. [] 

The total cross section for the single t-production is given by: 

0"tot (e + e~ -> t c, ctj = a-, + a z + cr int (21) 



with: 



(7. 



iV g e 2 



(|C 7 | 2 +|i^ 7 | 2 )) C/3 , (22) 



G 7 



^ While completing this work an additional preprint has appeared on the same issue ffl| . 

tin the following formula for (Ji n t the imaginary parts of the form factors are kept for completeness only. In 
calculating the cross section it was assumed that these imanginary parts vanish and that C and D are of the 
same size. These assumptions are made for definiteness only and should not influence the results qualitatively. 



N c e 



»l-4.. 



2 



167rV2m?^ 1 J (a - Aff) a + T|M| 0/3 

2(s - Mf ) (ReC^ReCz + ImC^ImC z + ReD J ReD z + ImD^ImD z ) 
-2T Z M Z (ImC^ReCz - ReC^ImCz + ImD^ReD z - ReD 7 ImD z )] . (24) 

The following abbreviations have been used: 

2 /o2 <q2 o q4 i o^c^t 



aIld f \1 f X2 2 2 

+ s ~ s ± s 

Numerically we find for BR 1 = BR Z = 1% at 

= 190GeV : a tot = 6.3 ■ lQ- 2 pb (25) 

and at 

y/s = 200GeV : cr tot = 13.2 ■ 10~ 2 pb . (26) 

In case of an integrated luminosity of 170 pb _1 /year one has 11 events or 22 events re- 
spectively. In view of the uncertainty of the vertex parameters C, D very detailed prediction 
cannot be made, but our result is encouraging. It seems not totally hopeless to look for t- 
quarks produced singly at LEP II. Of course, if this production is observed, it would be a clear 
indication towards a violation of the Standard Model [ |i~2|j . 

Single Production of t-quarks at HERA 

It is well-known that in ep-collisions at high energy studied at the experiments at HERA 



t-quarks cannot be produced at an observable rate if the Standard Model is valid [T3| . In our 
case the reaction ec — > et can take place. Note that the c-quark is present inside the nucleon 
as part of the gg-sea. The differential cross section is given by: 



da(ec — > et) 
dt 



1 ^ * fv fv 



16n 



E, J V 
9v9v'-jr~ ■ 



V,V'=-y,Z 



A v A v , D v (t)D v ,(t) 
\^C V C* V , + D v Dy,) {v v v v , + a v av) - (l + /? 4 ) t - (l + f3 2 ) 

+ (C v D v ,+D v C v ,)(v v a v> + a v v v ,) (l - /3 4 ) t + (l - (3 2 ) - .(27) 



s 



For definiteness 4^- and 4^- are both fixed to — in the following numerical examples. 
Further constants are g 1 = (—i)Q e , where Q e is taken to be — e, and gz = ( — ^75) 7 



The propagators in the t-channel are given by D 1 (t) = t and Dz{t) = t — M§ respectively. 
The constants ay and Vy are the standard axialvector and vector coupling constants of e~ or 
e + with the boson V = 7, Z and finally (3 2 = 1 — m 2 /s. 

The dominant contribution comes from the 7-exchange which is given by: 

' a+/*, , 28) 



= M + \D-, 

at 8%mf ^ 



t 



It becomes obvious that the cross section gets the largest where t is the smallest. Note 

2 in the limit s ^> inf. 



that \t\ min is proportional to m 2 e in the limit s 2> namely 



S Z 

The dominant contribution to the production cross section thus comes from the phase 
space region near the threshold, where in the quark-lepton c.m.s. the incoming lepton looses 
all its momentum; the energy is transferred to the quark system in order to produce the heavy 
t-quark nearly at rest - in that particular frame. In the laboratory system both the t-quark 
and the lepton have no sizable transverse momentum, and the lepton will be lost in the forward 
direction. The t-quark will decay emitting a b-quark and a W-boson. 

In order to calculate the cross section for ep — > etX, it is necessary to integrate over the 
charm quark distribution function. In case of HERA, where the incoming lepton has an energy 
of 27.6 GeV, the c-quark needs to have a momentum of more than 277 GeV (x > 0.338) such 
that a t-quark can be produced. Thus the cross section is particularly large, if the c-quark 
distribution is as stiff as possible. 

If one utilizes e.g. the charm distributions that Martin et al. have extracted from a global 
analysis [T3J] and assuming BR^ = BRz = 1%, the cross section is about 7 ■ I0~ 4 pb which is 



too small to be observable at HERA. This conclusion remains the same even if the parameters 
C and D are allowed to saturate their bounds in Eq. (|20|) because these distributions fall off 
quickly for large x. 

Alternatively we have considered charm distributions with a different large-x behavior. Of 



particular interest is the "intrinsic-charm" -case [15). The event rates have been calculated for 
the following two distribution functions that are based on the "intrinsic-charm" hypothesis 

rani: 



ci(x) = t^N 5 x 2 



-(1 - x)(l + lOx + x 2 ) + 2x(l + x) lnx 
3 



(30) 



c 2 (x 



210 



N 5 x 8 35 + 1155a: - 1575a; 2 - 11375a; 3 - 2450a; 4 + 490a; 5 - 98a; 6 + Ux 7 - x 8 



+x (1443 + 7161s + 5201a; 2 + {840 + 5880a; + 5880a; 2 } In; 



(31) 



(Note: N$ = 36 (N$ = 288028) have been used such that c(x) is normalized to 1%. 
The distribution function c(x) is identical to c(x).) Again making use of the assumption 
BRy = BR Z = 1% one finds: 



ci(x) : (T t ot = 1.7-10 2 pb. 



(32) 



c 2 (x): a tot = 3A-10- 2 pb. (33) 

With an expected integrated luminosity of about 100 p6 _1 /year one could therefore hope 
to observe a few events of this type for sufficient running time and favorable circumstances. 

The topology of these events is such that it could not be explained within the Standard 
Model. If the W decays leptonically, one would observe a 6-jet (or 6-jet) plus a high energy 
electron or muon. 

It is interesting to note that the Hl-Collaboration has recently reported the observation of 
several events with a high energy isolated lepton |T7[ . Three of these events in a data sample 



of 36 pb~ l show "kinematic properties atypical of Standard Model processes". The production 
of single t- (or t-) quarks could in principle generate this type of topology and kinematics. 
As a test of this hypothesis it would be mandatory to search for those events in which the 
W decays hadronically. For these events one expects to see three jets with jet momenta that 
should match to give the mass and momentum of the decaying top-quark. 

Acknowledgement: We would like to thank Dr. S. Brodsky and Dr. A. Leike for useful 
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